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ABSTRACT 


This study compares three single variable search methods — 
Golden Section, cubic interpolation and quadratic interpolation. 
The SUMT nonlinear program was used for the comparison. The 
OPT subroutine which performs the single variable search in 
SUMT currently uses the Golden Section method. Two different 
OPT subroutines were written which implemented cubic inter- 
polation and quadratic interpolation. Seven test problems 
which contained 9-100 variables and 2-20 constraints were used. 
The comparison was made on computation time per single variable 
search for the three methods and the number of function evalua- 
tions per single variable search for the Golden Section and 
quadratic interpolation methods. 

A single variable search by Lasdon, Fox and Ratner and 
one by Fletcher and McCann were also discussed. 

The results showed that the quadratic interpolation was 
slightly faster than the other two methods and required fewer 
function evaluations per single variable search than the 
Golden Section method. Time per single variable search was 
approximately the same for the cubic interpolation and Golden 
Section methods. Cubic interpolation required fewer points to 
be evaluated than the other two methods but the need for 
gradient evaluations proved to be costly in terms of computation 


time per single variable search. 
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ial RoOmUCTION 


The concept of optimization has grown to play a major 
role in the analysis of many complex decision and allocation 
problems. The quality of the analysis not only depends upon 
the skill and good judgement used in interpreting and 
modeling the problem but also upon the reliability and 
efficiency of the vehicle used for finding a solution to the 
problem. The solving of nonlinear programming problems has 
seen substantial development during the past twenty years 
and, no doubt, will increase in acceptance and popularity in 
the future. 

Within the Department of Defense several problems of 
Significant importance, such as weapons targeting and alloca- 
tion, aircraft and power plant design and manpower planning, 
to name a few, have arisen which are nonlinear in nature. 
Some examples of industrial nonlinear programming problems 
include oil refining, curve fitting, inventory and logistics. 

Many methods exist for solving nonlinear programming 
problems. Some of these methods, called penalty function 
methods, are based on transforming a constrained minimization 
problem into a sequence of unconstrained minimization 
problems whose solutions approach the solution of the 
Original constrained problem. 

In the penalty function method, as well as in most other 


nonlinear programming algorithms, a one dimensional 





minimization search is used repeatedly in the solution 
process. In this paper several different one dimensional 
minimization search methods are compared in the context of 
penalty function algorithms. 

The different one dimensional minimization search methods 
(also called single variable searches) are compared by the 
amount of computation time and by the number of function, 
gradient and Hessian evaluations of the objective function 
and constraints needed to find a solution to the original 
constrained optimization problem. 

Section II of this paper explains the formulation of 
the penalty function method and where the single variable 
search is used in this method. The nonlinear computer 
program SUMT is used in comparing’the different Single 
variable search methods and is also explained. 

Section III formulates the different single variable 
search methods — Golden Section, cubic interpolation and 
quadratic interpolation — and also discusses several other 
methods which were not programmed because of their 
complexity. 

Results and comparisons of the different methods are 
Stated in Section IV with conclusions and suggestions for 
further study in Section V. The Appendix contains the 


computer codes for the three methods that were programmed. 





It. THE PENALTY FUNCTION METHOD 


A. THE OPTIMIZATION PROBLEM 
The single variable search is a major part of finding 
an optimal solution to a constrained optimization problem 
by the penalty function method. Dr. W.C. Mylander, an 
author of the SUMT computer code, estimated that forty percent 
of the computation time required to find an optimization 
problem solution using SUMT involved single variable searches. 
The constrained optimization problem to be solved is of 


the form: 


minimize: £ ) 
subject to: Sia 2) 20 je = lees 6 fill 
Be OF = 0 eee Fleeces 10 Okey 


where x is an n-dimensional vector, the functions f£, g and h 
are continuous and may be either linear or nonlinear, and 
the set of values satisfying the inequality constraints has 


a non-empty interior, i.e. {x: g(x) > Ome l,..2,m) 


B. THE SUMT COMPUTER PROGRAM 

The computer program used to compare the different single 
variable search methods was SUMT - Version 4 (Sequential 
Unconstrained Minimization Technique for Nonlinear Programming) 
coded in FORTRAN IV by W.C. Mylander, R.L. Holmes and G.P. 


McCormick for the Research Analysis Corporation [Ref. 1]. 
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It was written to experiment with different methods of 
solving nonlinear programming problems. 

A Guide to SUMT - Version 4 [Ref. 2] is the program manual 
which contains detailed information about the development of 
the code, the subroutines, options, input-output, limitations, 
user-supplied subroutines, data deck setup and a detailed 
example of the use of the program to solve a nonlinear 
programming problem. 

The method used by SUMT to solve the original constrained 
optimization problem is described in detail in Chapter 8 of 
the book on nonlinear programming by Fiacco and McCormick 
(Ref. 3]. Basically, SUMT solves the constrained problem 
by finding the solutions of a sequence of unconstrained 
problems which approach the solution of the original con- 
strained problem. 

Previous versions of SUMT used different penalty functions 
for approximating the solution to the constrained problem but 
the function currently used to sequentially solve the problem 
is of the form: 

m m+p 


Bier) = f(x) - cr £ iIng.(x) + & (hy (x) 1°/r 
== J j=em+1 


where the parameter r determines the severity of the penalty 

and consequently how closely the unconstrained problem 

solution approaches the solution to the constrained problem. 
The penalty function of SUMT uses the mixed interior 


point-exterior point method described in detail in Chapter 4 


dE 





Senet. 2. The term, rt in oa , involving the 
inequality constraints fee oe the interior point method 
which is also known as the barrier method. As the x vector 
approaches the boundary of the infeasible region for these 
Rage rol nts, this term approaches infinity. The term, 

a [h. (x) }*/r , involving the equality constraints is 
Be mn the exterior point method. As the x vector moves 
farther away from the feasible region for these constraints, 
this term approaches infinity. The behavior of these two 
terms is shown graphically in Figure 1. How much of a 
penalty these terms add to the penalty function depends upon 
the value of the parameter r. 

The solution procedure requires minimization of P(x,r) 
over those x satisfying the conditions ae > OD fa ees 
for r = Cyrloreee where i, < Fy <eee S TE < eee S O . Under 
Mild conditions on the original NLP problem the minima of 
the sequential unconstrained problems approach the solution 
of the original constrained problem as rm > Of “ihe cend:— 
tions to be met for the method to solve the original problem 
are described in detail in the SUMT program manual [Ref. 2]. 

When the NLP problem is convex the SUMT program also 
generates a sequence of points that are feasible for an 
optimization problem called the dual of the original prob- 
lem. The. maximum function value of the dual feasible points 


and minimum function value of the unconstrained problem 


bracket the optimal solution of the constrained problem. 


iZ 
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b. EXTERIOR POINT METHOD INVOLVING EQUALITY CONSTRAINTS 


FIGURE 1. BEHAVIOR OF THE PENALTY TERMS 
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As the unconstrained problem is minimized and the number of 
dual feasible points found increases the difference between 
the two solutions decreases and the optimal solution is more 
accurately approximated. 

SUMT makes use of the theory derived in Fiacco and 
McCormick's book [Ref. 3, Chapter 5] that uses the Lagrange 
extrapolation technique to approximate the solution of the 
constrained problem when more than one minimum of the 
unconstrained problem has been found. By using these 
extrapolation approximations the solution converges faster 
and achieves a closer approximation to the actual solution 
than the minima of the unconstrained problems. 

The logic of the computer program taken from the SUMT 
manual [Ref. 2] follows. 

STEP 1. 

Find an initial starting point Xo within the interior 
feasible region such that oa) So soa ly seen is. pele ecSkICl 
an initial point is not given or is not feasible, the program 
uses the optimization method to find one. 

STEP 2. 

Determine rye the initial value of r, which can either 
be an input parameter or a rule for choosing r, can be 
specified. 

STEP 3. 

Determine the minimum of the unconstrained penalty 


function for the current value of r. 
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STEP 4. 

Estimate a better solution using the extrapolation 
technique, if possible. 

STEP 5. 

Computation is terminated if the stopping criteria are 
satisfied thus yielding an approximate solution to the 
Original problem with accuracy depending upon the stringency 
of the stopping criteria. 

STEP 6. 

If the stopping criteria are not satisfied select 
kK 

STEP 7. 

Go to Step 3. 

A simplified flow diagram of the computer logic taken 
from the SUMT manual [Ref. 2, p. 5] is shown in Figure 2. 

The single variable search problem is involved in Step 3 
of the procedure. In order to minimize the unconstrained 
penalty function the program chooses a search direction in 
n-space. It is believed that by searching in this direction 
from the starting point of the subproblem the penalty function 
will initially decrease. A one dimenSional search is then 
made along that direction until a local minimum is found. 

At the solution to this one dimensional search problem a 
new search direction is computed and a new one dimensional 
search is performed. The one dimensional searches are 
repeated, each time with a new search direction, until the 


unconstrained problem for a given r is solved. 


ve 





Sees READ IN PARAMETERS 
AND STARTING POINT 


(caltted in Phase Tp 
eK) mise In g; (x) 
mp 1=1 
+S Ee h.2(x) 
jamtl J 


IN PHASE I KEEP A CONTINUAL CHECK TO 
SEE IF ANY VIOLATED CONSTRAINT IS 
SATISFIED, IF SO @ TO l. 


MAKE SOLUTION ESTIMATES 


PRINT OUT f, g, h PHASE I OR II? 
AND ESTIMATES 

DOES A FEASIBLE STARTING 

POINT EXIST? YES 


(a0) PRINT OUT THIS FACT 


FIGURE 2. SUMT Program Flow Diagram [Ref. 2, p. 5] 
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SUMT allows the user to choose one of three procedures 
to determine the search direction — by Newton's Method using 
first and second partial derivatives of the unconstrained 
penalty function, by using the negative of the gradient of 
the penalty function or by a variable metric method which is 
taken from an algorithm of the Fiacco and McCormick book 
BRet. 3, pp. 170-175]. 

Finding a solution to the unconstrained n dimensional 
problem thus requires several single variable searches. 
Therefore, the more efficient the single variable search is, 
the faster the computation time will be. Given a direction 
of search, the SUMT program uses the subroutine OPT to 
perform the single variable search. In this paper, the 
presently used single variable search method in the OPT 


subroutine is compared to other single variable search methods. 


ly 





IiI. SINGLE VARIABLE SEARCH METHODS 


Since a major portion of finding a solution to the 
constrained optimization problem involves single variable 
searches, the SUMT program was used to compare several 
Single variable search methods. 

The current OPT subroutine of SUMT uses the Golden 
Section search method to perform the single variable search. 
Two different single variable search methods were programmed 
to replace the current OPT subroutine. The first method 
uses cubic interpolation once the local minimum is 
bracketed to accelerate convergence to that local minimum 
and the second method programmed uses quadratic interpolation 
to accelerate convergence once three feasible points that 
bracket the local minimum are found. Single variable search 
methods by Lasdon, Fox and Ratner [Ref. 4] and Fletcher and 
McCann [Ref. 5] are also discussed. . 

The object of the single variable search is to find a 
scalar 9 called the step length such that x* = x qe leis 
where x* is the x vector that corresponds to the local 
minimum of the penalty function along the search direction s 
from an initial starting point Xo° For ease of notation 
penalty function values are shown as a function of step 
length 9 in each single variable search since the initial 
starting point the search direction s and the parameter 


r are constant, i.e. P(8) = P(x +6*s,r). 


ee 





The optimal step length could possibly be found by 
moving along the search direction in a random manner. 
However, this would not be a very logical way to attack the 
problem and would lead to many needless evaluations of the 
penalty function which would increase computation time. 

The OPT subroutine is supplied with a search direction 
and an initial point from which to search. It must call 
Other subroutines of the SUMT program for functional, 
gradient or Hessian evaluations and is expected to return 
with a penalty function value and corresponding x vector 
which is the local minimum for that single variable search. 
It is assumed that the penalty function has a finite local 
minimum along the given search direction. 

The following subsections formulate and explain the 


different single variable search methods. 


A. GOLDEN SECTION SEARCH METHOD 

The Golden Section search method uses the limiting 
properties of the Fibonacci series [Ref. 6]. Fiacco and 
Mecormeck's book [Ref. 3] define the steps of the procedure 
used in the Golden Section method. 

Slee. 

First an upper bound step length O15 is obtained with the 
lower bound step length oF initially equal to zero. Bry is 
obtained by evaluating the penalty function at successive 


step lengths which are in the limiting Fibonacci ratio, 
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k . 
(l1+V75 )/2 =~ 1.618 , that is, 6, = 2 (1.618)7 , where 
i=0 


k is the smallest integer j such that 


5 Q spel Q 
Pa? © oe 61 8) Pee ee ola ji] 
2=0 2=0 
ae Q 
with oF updated as ££ (1.618) 
2=0 


Sie 2. 
The interval bounding 6@*, the optimal step length, is 
reduced by computing two other step lengths within the 


interval (0, ,6)) Their corresponding values are: 


6 = 6 


_ L + 0.382(6,, - 6 


> 


6, = 6B. + 0.618(6,,- 6 


. L oe 


L 


SLEe Sis 
The penalty function values of the two interior step 


lengths, Oe and @ are then compared. 


b! 

STEP 4. 

Pt P(6.) < P(6,), then the optimal step length which 
corresponds to the local minimum of the single variable 
search should be in the interval (6, 8) if the penalty 
function is unimodal. Because of the fact that 
0.382/0.618 = 0.618, reassign 8 = Gn7 8, = 0. and calculate 


a new oe as computed in Step 2. Return to Step 3. 


Zo 





SEse oO. 


ttf Ate) > P(@,), then the optimal step size should be 


in the interval (6. ,8 ). Reassign Ce ar oe = 


U a a b 
calculate a new 0, as computed in Step 2. Return to Step 3. 


and 


STEP 6. 

If the penalty function values at both interior step 
lengths are equal, reassign oF. = Oo OF = a and calculate 
a new 0. and on as computed before by returning to Step 2. 

STEP 7. 

When the stopping criteria is satisfied as explained 
in subsection III.D, 8* is approximated by (6, +6,,)/2 
yielding an x vector x* = Xx, + O*S which corresponds to an 
approximated local minimum P(6*) of the single variable 
search. 

A flow diagram of the Golden Section method presently 
used in the OPT subroutine is shown in Figure 3. Certain 
Pome -eOcmene COMPUECCE COde that were the same in each of 
the OPT subroutines are discussed in subsection III.D. 

The Golden Section OPT subroutine initially updates o. 
as it finds more feasible points by increasing the step 
length until it finds a point which is infeasible or where 
the penalty function value is larger than the penalty 
function value at the previous feasible point. If it finds 
an infeasible step length, the penalty function is assigned 
a very high value Qo 2 the next to the last feasible 


step length is assigned oF and the last feasible step length 


asSigned as the lower interior step length 0: fis tiewr i rst 


Zan 








9 
oa a 


9 = 
a 


O u 
INFEAS 
















NO 5 
3 POINTS FOUND? Cen 
fs os = 0.382(0,- 8) + 
= a. * 
®, = 0.382(6,~0.) + 6, X + 6,%s 
=e x 
X= X + 6s INFEAS 







STOPPING CRITERION MET? 
COMPARE P(8_) & P(6,) | GREATER 
THROW AWAY RIGHT SIDE 
es 
9 = 86 
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b 
Bp) 22(e, = 0) + er 
xX X + 9 ¥*s5 
ra) 
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Il 





= 0.382 (8, - 8) ol oF 


a 
= + 0. * 
X Xo v*s 
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@= (6,+8)/2 
YES 
STOPPING CRITERION MET? D> RETURN 


mprewRe 2. Golden Section OPT Subroutine 






a2 





step length from the initial point is infeasible, the lower 


interior step length oe =F Osge7 6 Since only one feasible 


uy! 
step length (6, = 0) has been found. OPT then uses OF and 
ae to compute the upper interior step length 

Sa 0. + 0.382(0,,- 6). The optimal step length is 
bracketed and the subroutine continues to reduce the 
interval of uncertainty by comparing penalty function values 
of the interior step lengths until it finds two values or 

an interval that satisfies the stopping criteria. 

In finding the minimum of each single variable search, 
the Golden Section method only requires penalty function 
evaluations which are compared to show where the penalty 
function decreases to a local minimum and then increases to 
infinity as the infeasible region boundary is approached. 
The factor by which the interval of uncertainty is reduced 
remains constant in this method. Therefore, any information 
about the behavior of the penalty function other than the 


fact that the optimal step length is somewhere within the 


interval of uncertainty is disregarded. 


B. CUBIC INTERPOLATION METHOD 

The cubic interpolation method was programmed for 
comparison with the Golden Section and quadratic interpola- 
tion methods. Basically, this method approximates the 
penalty function by a cubic fit and then finds the minimum 
of the cubic equation to approximate the optimal step 


length of the single variable search. 
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In order to approximate the penalty function by a cubic 
fit in the single variable search, two feasible step lengths 
which bracket the local minimum along with their directional 
derivative values are needed. This method actually consists 
of two distinct parts — the bracketing section to find the 
two feasible points and the cubic interpolation section to 
find a minimum of the cubic function. The single variable 
search method is supplied with an initial starting point Kos 
the penalty function value at Xo [P(0)]}], the gradient of 
the penalty function at Xe [VP(0)] and a search direction s. 

The steps of the cubic interpolation method follow. 

Sree i. 

Since the directional derivative at the starting point 
P'(0) is negative, by finding a step length that has a 
corresponding positive directional derivative, the local 
minimum along the given direction of search will be bracketed 
if the penalty function is unimodal. 

The step length is increased to find an upper step 


length rr until an n is found such that 


Veh S06. 
i 


Pit 
x 


tums 


If, while initially increasing the step length, an infeasible 
point is encountered, the increment by which the last step 
length was increased is halved and subtracted from the 
current step length. This is continued until a step length 


that is feasible is found. If its directional derivative is 
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negative, the increment is increased by one half the 
increment length and added to the current step length. 
This is continued until a step length with a positive 
directional derivative is found. 

The lower step length OF 1s always the last feasible 
step length encountered with a negative directional 
derivative. 

STEP 2. 

Once two step lengths have been found that bracket the 
local minimum along the search direction, the cubic equation 
is used to compute a step length which corresponds to the 


minimum of the cubic fit. This step length is found by the 


equation: 
P'(6..) + U, - U 
U L 2 
where P (0, _ P (81) 
Cee ee es | 
iL L U OF Oy 
= eT ' We 
U, = [U, P'(6,)P (6,5) ] 
STEP 3. 


P'(9) is evaluated and if it is negative then reassign 


oF = §@ and the left side is discarded. If P'(6) is positive 


then reassign Bry =9 and the right side is discarded. 


Ze 








STEP 4. 

If the stopping criteria is satisfied, the two penalty 
function values, P(8) and P(8,) or P(8) and P(G), depending 
upon P'(8), are compared and the smallest one is returned 
as the local minimum P(8*) of the single variable search 
with its corresponding x vector, x, + O%s. 

SlEP a. 

If the stopping criteria is not satisfied return to 
Step 2. 

A flow diagram of the cubic interpolation OPT subroutine 
is shown in Figure 4. The parts of this subroutine that are 
the same in the other OPT subroutines are discussed in 
subsection III.D. 

The cubic interpolation method uses more information at 
Soemmreasiole step length to find the local minimum of the 
Single variable search than the Golden Section or quadratic 
interpolation methods. It requires a gradient evaluation 
for the penalty function at each feasible step length in 
order to compute the directional derivative. A gradient 
evaluation may require many function evaluations depending 
upon the number of variables and constraints in the original 
constrained problem. However, with this extra information 
the local minimum should be found by evaluating fewer step 
lengths in the cubic interpolation section of this method. 
As the value of the parameter r decreases with each 
unconstrained problem, the penalty function rises more 


abruptly as the infeasible region boundary is approached. 
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FIGURE 4. Cubic Interpolation OPT Subroutine 
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This makes it more difficult to find a step length with a 
positive directional derivative which is required to bracket 


the minimum. 


C. QUADRATIC INTERPOLATION METHOD 

A quadratic interpolation single variable search was also 
programmed for comparison with the two previously discussed 
methods. 

This method requires three feasible step lengths and 
their penalty function values which obey the relationship 
P(6,) > P(6,)) < P(8,)) where oF < OM < Oy : With this 
information a quadratic fit is made with its minimum 
approximating the minimum of the penalty function for the 
given search direction. The penalty function is evaluated 
at the interpolated step length which minimizes the quadratic 
function and compared to P(6,,) allowing the interval of 
uncertainty to be decreased. The process is repeated until 
the minimum of the quadratic fit approximates the local 
minimum of the penalty function or the interval of uncertainty 
becomes small enough to satisfy the stopping criteria. 

This method also consists of two sections — the bracketing 
section and the quadratic interpolation section. The single 
variable search is supplied with an initial x vector a its 
penalty function value P(0) and a search direction s. 


The steps of the quadratic interpolation search method 


follow. 
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See. 

Bhewseep fength is increased from the initial starting 
point to find an upper step length Ory until ann is found 
such that 

n Te ee 
Poezale- 1) > Pf (27) - 1) . 
i=1 i=1 
If, while initially increasing the step length, an infeasible 
step length is encountered, the increment by which the last 
step length was increased is halved and subtracted from the 
eurrent step length. This is continued until a feasible step 
length is found. If its functional value is less than P(O,), 
the increment is increased by one half the increment length. 
This is continued until a-feasible step length is found that 
has a larger penalty function value than the previous step 
length. Before this is repeated, reassign OF = 0, and 
0. = 0 | 


M U’ 
If only one feasible step length is found in obtaining 


always ensuring that P(8,) > P(0,,) - 


the upper step length, where in this case P(9,)) > P(6,) 
(which indicates the minimum is bracketed), the last 
increment is halved and subtracted from the upper step 
length which yields the interior step length O° 

SURE 2. 

Now that the local minimum is bracketed, the quadratic 
function is used to find a step length where the derivative 


of the quadratic fit vanishes. 


eo 





1 b53P(6,) + b,P(6,) + By 2P(8,,)) 


8 See (Oey ot as P(o.,) + a..Pto..) 


SEP 3. 
i. 9 > Ou! then the left side is discarded and reassign 
85 = 9y and Om =e Lt @ < Our then the right side is 


discarded and reassign OF = 6. and Ou = 0. 


M 

STEP 4, 

P(6,)) is evaluated and if the stopping criteria.are 
satisfied, the smallest of P(6,), P(6y) and Pie els erecunaed 
as P(6*) with the corresponding x vector, x, + 6¥s. 

STEP 5. 

If the stopping criteria are not met, return to Step 2. 

A. flow diagram of the quadratic interpolation method OPT 
subroutine is shown in Figure 5. 

The quadratic interpolation method only requires function 
evaluations to perform the single variable search. It uses 
the knowledge of three feasible step lengths and their 
penalty function values to approximate where the local 
minimum of the single variable search is located. However, 
it must find an upper feasible step length that is within the 
interval where the penalty function is increasing to infinity 
and also this feasible step length must have a penalty 


function value that is greatar than that of the interior 
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feasible step length. This causes the interval containing 
possible feasible upper step lengths to be reduced even more. 
As the parameter r decreases for each unconstrained sub- 
problem, the penalty function increases more abruptly from 
the minimum as the infeasible region boundary is approached. 
This also increases the difficulty in bracketing the minimum. 
Once the three feasible step lengths are found, the 
quadratic interpolation can converge to the local minimum 


thereby solving the single variable search. 


D. SECTIONS COMMON TO THE DIFFERENT METHODS 

Some parts of the three different OPT subroutines were 
made similar so that they could be compared under the same 
Semdl tions . 

Essentially the same stopping criteria was used in each 
subroutine. When the ratios of the two x vectors that 
bracketed the minimum or ratios of their penalty function 
ee were within 10°! of one, the subroutine returned to 
the program with a local minimum and a corresponding x vector 
as the solution to the single variable search. These criteria 
were checked in the Golden Section method whenever two 
interior step lengths had been computed and in the inter- 
polation methods both after the minimum had been bracketed 
and also after each interpolated step length had been 
computed. 

In the three different methods, the subroutines also 


contained counters which would cause the search 1:0 stop 


Se 





Prectwect interpolations in the cubic interpolation method, 
twenty interpolations in the quadratic interpolation method 
or twenty-five feasible points in the Golden Section method. 
In the test problems that were run these counters were never 
reached, thereby, never satisfying this stopping criterion. 

In the cubic interpolation method another stopping 
criterion was used along with the ratio tests. When the 
cosine of the angle between the gradient of the penalty 
function and the search direction vector was less than age 
the subroutine returned with a local minimum and x vector. 

It was stated earlier that it was hoped that the penalty 
function would initially decrease in the given search 
Girection from the initial starting point. In the three 
different methods, if the ratio of any element of the 
current x vector and the corresponding element in the initial 
xX vector came within on of one, the single variable search 
was restarted in the opposite search direction. In the 
interpolation methods if after one hundred tries the minimum 
was not bracketed or the step length had been decreased more 
than twenty consecutive times, the search direction was also 
reversed and the single variable search was restarted. 

The three different OPT subroutines called the subroutine 
EVALU for penalty function evaluations. EVALU would return 
back a variable after each call up which would show if the 
step length was feasible. The cubic interpolation method 
called the subroutine GRAD for the gradient of the penalty 


function when it was needed to determine the directional 


derivative. 
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E. OTHER SINGLE VARIABLE SEARCH METHODS 

Two other single variable search methods were also 
looked at but were not programmed because of their complexity 
and their need for changing other portions of the SUMT 
program than just the OPT subroutine. 

1. Lasdon, Fox, and Ratner Method 

The single variable search developed by Lasdon, Fox 

and Ratner [Ref. 4] uses a penalty function that doesn't 
contain equality constraints and the penalty term for the 
inequalities is also different than the SUMT penalty function. 


The unconstrained minimization problem is: 
Mamma ze Pix,r) = E(x) tex 2 Guar 


where F is the objective function and the G,'s are the 
inequality constraints. This model could be modified to 
handle equality constraints and a penalty function like that 
used in SUMT. 

The single variable search method is in three distinct 
stages — linear approximation, quadratic approximation and 
cubic interpolation. Linear approximations are made for the 
objective function and each constraint using F(0), F'(0), 

G; (0) and G5° (0). A step length (64) which minimizes the 
penalty function consisting of the linear approximations is 
then calculated. The information used to make the linear 
approximations is then used along with F(68,), F'(0,), G.(8)) 


and G5 ° (64) to make quadratic approximations of the 


34 








objective function and constraints. The penalty function 
consisting of quadratic approximations is then minimized 
by computing 05 - If the directional derivative of the 
Original penalty function is positive at O55 ablonke sang =ne— 
polation is applied yielding 6*, the solution to the single 
variable search. If the stopping criterion is satisfied 
during any stage, the single variable search is terminated 
yielding a local minimum and a solution to the search. 

The following steps outline the Lasdon, Fox and 
Ratner procedure. 

STAGE l. 

The objective function and inequality constraints 
of the original constrained problem are approximated by 


using the given values at the initial starting point. 


£, (8) F(0) + F'(0) 


Gy, (8) = G5 (0) am G; (0) et aewilt, alec 7 lle 


The approximating function for P(8) is 


= 1 


The smallest positive zero of the linear approximations of 
the inequality constraints is found by taking the smallest 
~G5(0)/G, (0) over all j. This value is designated the 
upper step length Oty: 

The step length corresponding to the minimum of the 


approximated penalty function is found by Sloubole) Skelble’ (one esi t= 


SS 





Newton's method iterations using > By ase Gheestarting DOLNt. 


ated 


U 1 


8 = L 8 ee eee 
2 1? 
eo a0 


il 


The result of this stage is a step length that 
approximates the optimal step length of the single variable 
search. If the stopping criterion, explained following 
Stage 3, is not satisfied proceed to Stage 2. 

STAGE 2. 

The same procedure is performed in this stage as in 
Stage 1 with the exception that quadratic approximations to 
the objective function and constraints are made instead of 
linear approximations. The second stage is entered with 
values of F(6,) and G3 (67) along with the information used 
to make the linear approximations. The quadratic approxima- 


tions to the objective function and constraints are 


£,(6) = ao + be + c 
z F(6,) = bo, - Cc 
where a = 
2 
Oy 
b = F' (0) ’ c = F(0) 
and 
Jo. (8) =d 9? as ©; a Ee J = 1,.-.,m 
G.(90,) - e.0, - £. 
where qd. = 1 i J 
j 9-2 
1 
Gee CO f. = G.(0). 


- 
ae 


= 





at G5 (8,) 1s infeasible for some j, then the smallest 


positive root over all j of 


es + Je.° ~44.£. 
ae ee 16 
2d; 2U 


1s used as the starting step length for using Newton's 


method to minimize the approximated penalty function 


m 
1 
Pee) — £4.(0) tor * 5 
2 2 q=1 Go. (8) 


The step length which minimizes Po (9) should be 


found after four or five iterations of Newton's method. 


Pere) 
6 = Q _ oe 
Z 1 iT 
538 oT is infeasible, use = Soy in Newton's method. 


If the stopping criterion is not satisfied after finding 
05 continue to Stage 3. 

STAGE 3. 

Direct cubic interpolation of the penalty function 
1s used in this stage. If P*(6.) is positive, the minimum 
is bracketed and cubic interpolation can be performed to 
find a step length which corresponds to the minimum of the 
penalty function. If the minimum has not been bracketed, 
maat is, if P'(6.) < 0, a bracketing procedure like the one 


used in the cubic interpolation method of subsection III.B 
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must be performed to find a step length that has a positive 
directional derivative. Once this step length is found, 
cubic interpolation is used to find a step length which 
minimizes the cubic function. If the new step length does 
not satisfy the stopping criteria, additional cubic inter- 
polations are made using the two points which most closely 
bracket the minimum of the penalty function. 

When two penalty function. values are nearly equal 
or when the interval between step lengths that bracket the 
minimum becomes very small, an optimal step length is deter- 


mined by 


eee 4) Ome ron) On 


P'(o0.) - PB (6,) 


where 8 is the lower step length and 8, is the upper step 


b 
* 
length coe eg < 8) - 


The stopping criterion used in this method is the 


a 


iT 
cosine test |cos $]| Seeoe SUE , where 9 is the angle 
Lisl {11 9P || 


between the search direction vector and gradient of the 
penalty function. When the cosine of the angle is less than 


107° 


, the stopping criterion is satisfied. 

The authors found that in using this method on test 
problems, the stopping criterion was often satisfied at the 
end of Stage 2. In their comparisons of this method with a 
cubic interpolation method, they found that it performed 


the single variable search much more efficiently {[Ref. 4, 


mee 295). 
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This method requires gradients of the objective 
function and constraints. In the SUMT program these values 
are not stored so implementing this method would require 
more storage or more gradient evaluations along with 
changes in other subroutines and/or addition of new 
subroutines. 

2. Fletcher-McCann Method 

The Fletcher-McCann method [Ref. 5, pp. 210-212] 
uses an approximation of the original unconstrained penalty 
function to find the local minimum of the single variable 
search. The penalty function approximation used is of the 
form 


T(6) = a + bO + ca" + q 





where the parameters a, b, c, d and OF are determined by 
using objective function and constraint information at two 
feasible step lengths. The authors felt that an approximation 
of this type which goes to infinity at the barrier 0 = O15 
would fit the penalty function better than a polynomial 
approximation which goes to infinity only as 0->%, Oy is 
an estimate of the intersection of the search direction s 
with the boundary of the infeasible region. The approximated 
penalty function's minimum is found by applying Newton's 
method to find a step length which corresponds to the local 
minimum along the direction of search. 

Since the explanation of this method by the authors 


was rather sketchy, certain parts could be interpreted 
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differently and only resolved by testing the method on 
different problems. An explanation of the notation for 


this method is first given. 





ee 2 2 
F(0) = £(0) += £ h.“(6) x a+ bo +c 
j=m+1 J 
ie da 

Gieye= -r Ef In g.(e) = ——ct—— 
m+p 
| s'V£(8) +2 & h, (6) "Uh, (8) 
FE = _= 
(6) j=m+ 1 Ewa 
I}s|] 
oily 
m s Vg. (0) 
aCe = Hc) =; 
I}s]] j=l j eee) 


The single variable search is supplied with an initial point, 
functional and gradient information at that point and a 
search direction. The steps of the method follow. 

Sree 1. 

A feasible step length in the direction of search is 
needed along with the initial point in order to estimate the 
parameters a, b, c, d and Oy- A unit step length is initially 
taken in trying to find a feasible step length. If it is not 
feasible, the step length is progressively halved until a 
feasible step length is found. The lower and upper feasible 


step lengths are written as G5 and O51 respectively. At the 


start of the search Tr = 0. Function and gradient evaluations 
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are made at the second feasible step length in order to 
compute F,, Gy: FB)! and G,' (shortened notation for F(S,), 
G(6,), SEC). 

By using the information at the two feasible step 
lengths, Simultaneous equations are solved to determine 


the parameters. The parameter values are 


sa 0 if 
Cc — 
2(0, - 85) 
= ie 
b= Fo 2c8 5 





The parameter 8 is taken as the smallest value of two 
computed values which is greater than 0, - 

StEE 2. 

Once the parameters are determined, the equation for 
the minimum of T which is 


Tee bec 


2 
(61, - 9) 


is solved by Newton's method using the midpoint between the 


two feasible step lengths as the starting point. 
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1 
8, -6 Be ) 
1 2 
ae 0 
aan ier ] 
a 0, — 8% 
Tee 5 ) 
where T" = 2c + cee . 
U 
STEP 3. 


The values of VP(8) are computed and if the stopping 
criterion is satisfied, the single variable search is 
terminated with 6 as the optimal step length. 

STEP 4. 

If the stopping criterion is not satisfied, a new 
step length is computed using Newton's method in Step 2. 

The authors of this method stated that different 
default actions would be necessary in cases where the inter- 
polation failed or was unsatisfactory. For example, if fee 
the feasible step lengths, 84 and os, a value of oh, Coudd 
not be determined, it would be necessary to use another 
feasible step length to determine where the intersection of 
the search direction and the boundary of the infeasible 
region was. In later stages of the minimization the authors 
said that this method sometimes failed and a quadratic 
interpolation would have to be used. 

Implementing this method in the SUMT program would 
also require more storage or more gradient evaluations 


along with modifications to other subroutines and/or additional 


subroutines. 
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No comparisons are made of the Lasdon, Fox and 
Ratner or Fletcher-McCann methods to the other three 


methods since they are only discussed and not programmed. 
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IV. TEST PROBLEMS 


A. TEST PROBLEM ORIGIN 

The problems used to compare the three different single 
variable search methods programmed as OPT subroutines were 
taken from problems used in a thesis by Lt. J. Waterman, USN, 
which compared three different nonlinear programming codes 
(Ref. 7]. The SUMT program and problem data decks were the 
Same as those used by Waterman except for the Golden Section 
OPT subroutine being replaced by the cubic and quadratic 
interpolation methods. 

The structure and degree of difficulty among the seven 
test problems are quite varied and represent a sample of 
some real world problems. The number of variables and 
constraints ranged from 9 to 100 and 2 to 20 respectively. 
The problems contain combinations of linear, nonlinear, 
equality and inequality constraints. 

The following subsection contains the descriptions of 
the test problems as presented in Waterman's thesis. 
Constants in each problem are represented by a, b, c, d, e, UL, 


m, u ands unless otherwise specified. 


B. TEST PROBLEM DESCRIPTION 

Problem 1 was an example of determining the chemical 
Gempesition Of a Complex mixture under conditions of 
chemical equilibrium. It contained 45 independent variables 


and 16 linear equality constraints. 
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Le a k Xap 
mentmeze £(x) = + [ f x ye nee in =) ] 
k=1 j=l k 
ee ce 
j=. J* 
peas 
subject to lien Gs) Seo ge toy aes SS, se) b. = 0, 
1 eed ag swag 1 
= pe ep 26 
Xan 2 0 j = 1,..-,h, kK SS Wess 7, 


Problem 2 was formulated by the Shell Development 


Company. It consisted of 15 variables and 5 nonlinear equality 


constraints. 


10 > 5 5 3 
maximize £(x) = 2 b,x, =D: ee Geez 
i=l i j=1 J 
where y = C3 4* (1043) and Z= *(10+4) 
2S 3 a0 
subject to oe = 2 2 y + 3 a7 + Ba = z a5575 > 0 
i=l 1 
xe 20 iL = 1 ee 
a. = 


Problem 3 was to maximize the area of a hexagon in which 
the maximum diameter was unity. The problem had 9 independent 
variables, 13 nonlinear inequality constraints and a lower 


bound of O for XQ > 
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Maximize: f£(x) = -5(X]X,— X5x, + x Ke = Sex. + eX. = XLS) 


Srag a9 Seed 6 7 


subject to: l- X¥,° — X40 > 0 
1 - x,* > 0 
WS xo" ae x,° > 0 
1 - (x) — X,) - eo ee > 0 
1 - (x) ~x,)* - (x, -x,)7 > 0 
1 og cre - (x. a) Za20 
Lo (x4 - x)? (x4. - x,)* > 0 
a (x4 - x5) ° (x, le a 
= a = (X— - Xy) > QO 


5 
X3Xq > 0 
“XeXq aa 
XpX_g — X_X7 > 0 
Xq 2 0 


Problem 4 was probably the most difficult of the test 
problems. It included a linear objective function, 24 
variables, 12 nonlinear equality, 2 linear equality and 
6 non-linear inequality constraints. The variables had 


to also be zero or positive. 
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minimize: ix). =a a. x 


subject to: 


: (i+12) . mist 7 
h, (x) = ia. i) (Anon x5 Tio Ou x5 a 0, iS ity pe 
be » 40b 2 

1+12 b. be 

Jeane: J i ee) 

24 
h,3(*) = es xs - l= Q 

12 xs 24 xs 
hy,(*) = 2 qg tft ue ee 

i=l 1 i=13 a 


where f = 142.224 


eS eon 


SEEN Gee 3 a anne rs 
2 Lu 
j=l 7 
-(xX,. steie ay te ) 
_ (i+3) (i+15) = 
D i414) (x) a i= 24 $$ Ci = OT; J AD, 6 
2; > ae 
jal? 
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Problem 5 was a weapon assignment problem with 100 
variables, a nonlinear objective function, 12 linear 


constraints and zero lower bounds for the variables. 


20 5 
minimize: mej eae ae ( wee) a. eee) 
j=l 9 Gs, 23 
subject to: 
5 
» =a ban >) 0 ) = G0 AS ; - 
poe a Ghee J 6 ’ peor c 
20 
=e k.. +t ec. > O =e eee 
=a a5} i-— 
*i5 Ea i= ele J = eens 20 e 


Problem 6 was adapted from an inventory model where 
the Xs, 1 =1,...,50, represent the reorder quantity for 
50 inventory items and a 1 = 51,...,100, represent the 
reorder points for the same 50 items. It contained 100 


variables, 1 linear and 1 nonlinear inequality constraint, 


and 50 lower bounds on the variables. 
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minimize: E(x), = 
i=1 a 
where 
Be eee eee ec ec 
B, (x, + 50) = ieee er aoa a eae 
a 
d. = x =a » o(x) = 2 eX /2 
a L+5 — 
a or 
x 
and $(r) = f (x) dx 
tc 
subject to: 
50 Xs 
200,000 - 2 Cc, (> “ X (4450) = m, ) > 0 
1=1 
50 L. 
300 - 2& — > 0 
: eee 
i=l 1 
ewe p=" eee IOs 


Problem 7 was an entropy model. There were 46 population 
centers connected by a transportation network. Using a 
congestion cost function the model yields an equilibrium 
solution that identifies nodal populations as entropic 
functions of the total cost of the journey to work. The 
problem contained 46 variables, all of which have a zero 


lower bound, 1 nonlinear inequality and 1 linear equality 


constraint. 
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x 
minimize: ia = see an 
a foes Soo. 
1=1 
46 
subject to: 900 = ff x, = 0 
1=1 
46 7 
BOC00— Lenya. tead.y.. > © 
; alter i 
1=1 
where eee + 5 Xx. ; A(1) consists of all the 
5 
jJEA(i) 


arcs that converge directly and indirectly upon node i, 


and 


The preceding problem descriptions are only meant to 
give a feeling of the kind of test problems used and their 
structure. Detailed information of how each problem was 
set up, the constant values, initial starting points and 
where the problems specifically originated is contained 


in Ref. 5. 
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V. TEST RESULTS AND COMPARISONS 


A. PROGRAMMING AND TESTING PROCEDURE 

The cubic interpolation method was first programmed 
as a program that did a single variable search when given 
a penalty functicn, its gradient, an initial starting point 
and a search direction. After it had been debugged it was 
converted into an OPT subroutine. After the subroutine 
was debugged using a couple of the less difficult test 
problems, OPT was converted into the quadratic interpolation 
method by modifying the bracketing procedure and changing 
PicminterpOlation from a cubic function to a quadratic 
inet 2 ON. 

When the quadratic interpolation method had been dennagecs 
each problem was run through the SUMT program three times, 
using the three different scorn methods. As discussed 
earlier, the stopping criteria was made essentially the same 
in each of the OPT subroutines so that the only thing that 
varied in solving each test problem was the single variable 
search method. 

In the process of running the other test problems, minor 
debugging changes had to be made in the interpolation methods. 
After all the changes had been incorporated, a final run 
of each problem with each method was made which produced the 
results used in the comparisons. Each method found the same 


solution to each problem to within six significant figures. 


at 





B. COMPARISON CRITERIA 


Perhaps the best way to compare the different search 
methods is to compare the computation time required to find 
the solution to the problem. However, because of computer 
interactions, computation time may vary as much as twenty 
five per cent when the same problem is run at two Sale eee 
times. Computation times were computed for each problem to 
see if a trend could be seen between the methods. 

Counters were inserted in the SUMT program so that the 
number of single variable searches performed and the number 
of functional and gradient evaluations needed to find the 
solution could be counted. 

Results of the test problem runs are shown in Table I. 
In running problem 7 with the interpolation methods it was 
necessary to change the factor by which the increment was 
multiplied for step length increase or reduction to 1.618 
vice 2 and 0.618 vice 0.5 respectively. This change was 
needed because a feasible starting point was found in the 
bracketing procedures which the SUMT program could not solve. 
By changing the factors to the same as those in the Golden 
Section method, the same feasible starting point was used 


to solve the problem. 


C. COMPARISONS 
Theoretically, each single variable search should reach 
the same solution for all three methods. However, because 


of the tolerances allowed in the stopping critera, the 
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solutions were slightly different at the conclusion of each 
Single variable search. This meant that at the start of 
the next single variable search the search direction would 
be slightly different also. As several single variable 
searches were performed in each problem, the differences 
accumulated and this explains why for some of the problems 
it takes a different number of searches for each method to 
reach the same solution. This also explains the difference 
in the number of function and gradient evaluations required 
for each problem for the Golden Section and quadratic 
interpolation methods. 

Table II shows the normalized results for the time per 
Single variable search, function evaluations per single 
variable search and gradient evaluations per single variable. 

As was expected, the number of gradient evaluations per 
Single variable search is essentially the same for Golden 
Section and quadratic interpolation-methods. The only thing 
that can be compared between the three methods is the 
computation time per single variable search. Function 
evaluations per single variable search can only be used as 
a measure of effectiveness for Golden Section and quadratic 
interpolation since the cubic interpolation also requires 
gradient evaluations and fewer function evaluations. 

In looking at the times per single variable search the 
quadratic interpolation was faster than the Golden Section 
and cubic interpolation methods 5 out of 7 and 4 out of 7 


test problems respectively. Cubic interpolation was faster 
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Problem 


TIME 


hy 
Hou i 


PRB Er 1. 


NORMALIZED TEST PROBLEM RESULTS 


time/single variable search 
# function evaluations/single variable search 
# gradient evaluations/single variable search 
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than Golden Section in 3 of the 7 problems with the same 
time for problem 2. 

In comparing the number of function evaluations per 
Single variable search, the quadratic interpolation method 
required fewer than the Golden Section on all seven problems. 
In most of the test problems, it required between thirty to 
forty per cent fewer function evaluations. The cubic inter- 
polation method required fewer function evaluations than the 
other two methods because it used more information about the 
penalty function at each feasible step length to find the 
optimal step length. However, it required more gradient 
evaluations which increased the computation time making it 
about the same as the Golden Section and slightly slower than 
the quadratic interpolation. 

With a larger sample of test problems more statistically 
sound comparisons could be made of the three different methods. 
Also samples of test problems that are similar in structure 
could be tested to show if one method worked better than the 
others on those type of problems. 

It should be emphasized that the results in this thesis 
are obtained from single variable searches on a very special 
type of function — the unconstrained penalty function in the 
mixed interior-exterior penalty function algorithm. No 
attempt should be made to generalize these results to other 
nonlinear programming methods which also use single variable 


searches, but on a significantly different class Of PUuncELONS. 
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VI. CONCLUSIONS AND SUGGESTIONS FOR FURTHER STUDY 


A. CONCLUSIONS 

In looking at the computation time required for each 
Single variable search, the quadratic interpolation method 
was faster than the other two methods on the test problems 
that were run. The quadratic interpolation method uses 
information about the penalty function at each feasible step 
length to reduce the interval of uncertainty whereas the 
Golden peer reduces the interval of uncertainty by a 
constant factor. Because of this difference, quadratic 
interpolation proved to be slightly more efficient than 
Golden Section. The only drawback in the quadratic inter- 
polation method is the fact that bracketing the minimum can 
be quite hard to do. The cubic interpolation method reduced 
the interval of uncertainty in a more efficient manner than 
quadratic interpolation or Golden Section. However, having 
to make gradient evaluations to determine the directional 
derivative values proved to be very costly. The time per 
single variable search was about the same as the Golden 
Section search method. 

Tf the user of the single variable search method has 
prior knowledge about the complexity of the function or 
gradient evaluations he may prefer cubic interpolation over 
Golden Section or quadratic interpolation, or vice versa, 
since the cubic interpolation requires more gradient evalua- 


tions and fewer function evaluations. 
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B. SUGGESTIONS FOR FURTHER STUDY 

A combination of different methods made into a single 
variable search could be done with the three different 
methods that were programmed. This combined methods approach 
could use Golden Section until the minimum was bracketed, 
then use quadratic interpolation until the minimum 
was bracketed much closer and then finally use the cubic 
interpolation to home in on the local minimum of the search. 
The Lasdon, Fox and Ratner method uses three different stages 
that each find a feasible step length, with the final stage 
finding an optimal step length for the search. Another 
approximation of the penalty function like the Fletcher- 
McCann method could also be devised. 

Implementation of the Lasdon, Fox and Ratner or Fletcher- 
McCann method into the SUMT program with runs of the test 
problems would enable a comparison to be made not only to 
the three methods Bewiea in this paper but also between the 
Lasdon, Fox and Ratner method and Fletcher-McCann method. 

Another possibility for study would be to fine tune the 
three different methods by adjusting the tolerances and 
termination conditions to see that if by allowing a less 
“accurate determination of the minimum of the single variable 
search, the solution to the unconstrained problem could be 
found any faster. 

If a larger sample of test problems including more and 
varied types of nonlinear programming problems eomlawoe 


tested using the three different methods, a better comparison 
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could be made. The results may either show one method to 
be superior over the other methods in all of the problems 
or show each method suited best to a specific type of 

problem enabling the user to choose the method which best 


applies to the situation at hand. 
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APPENDIX 


GLOSSARY FOR GOLDEN SECTION OPT SUBROUTINE [Ref. 2] 


The vector indicating the direction of move 
in one dimensional optimization. S§S 


The gradient vector of the penalty function 
VP. 


The inner product of the move vector and the 
negative gradient vector of the penalty 
function. -S' VP 

Used as an index in DO loops. 

A switch showing whether the motion on a given 
vector failed to decrease the penalty function 
and the negative was tried. 

Used as an index in DO loops. 


Switch showing whether less than 25 feasible 
points were found on the direction vector. 


The number of inequality constraints 


Number of moves in search for a solution of 
a subproblem 


The number of variables 
Indicates whether constraints are satisfied. 


The number of the point on which the program 
is working. 


The number of points generated in attempting 
to find a point along the search direction. 


The number of infeasible points found on the 
direction vector. 


Switch showing that a feasible point on the 
direction vector could not be found and the 
negative was tried. 


Penalty function value ace ylower step Tengen 
Pe): 
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Peo 


PQ 


Pl 


P31 


RJ1 


XX 
X1 
X2 


X3 


Penalty function value for left interior steplength 
Pix Z 


Current value of the penalty function P(X) 


Penalty function value for upper steplength 
Ea) 


Benalty function value atoinitial starting pone 
Vector of current values of the constraints 
Vector of previous value of the constraints 

Vector of current value of the variables Xyt+Os 
Temporary storage used for switching vector values 
X vector of upper step length X,t+65s 


X vector of left interior step length Xy+9.s 


X vector of lower step length Xt8,s 
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GLOSSARY FOR CUBIC INTERPOLATION OPT SUBROUTINE 


Magnitude of the search direction vector 
Lower step length OF, 
Upper step length oe 


Cosine of the angle between the gradient and search 
direction vectors 


Factor by which increment is multiplied 
Search direction vector s 
Gradient vector of the penalty function 


VP(X) 


Gradient vector of penalty function for lower step 
length VP(X3) 


Gradient vector of penalty function for upper step 
length VP(X2) 


Directional derivative of interpolated step length 
times ADELX P' (X) 


Directional derivative of initial starting point 
times ADELX P' (X11) 


Directional derivative of lower step length times 
ADELX P'! (X3) 


Directional derivative of upper step length times 
ADELX P' (X2) 


Stepping Criteria tolerance Gor seosine test 
Index used in DO loops 

Index used in DO loops 

Index used in DO loops 

Number of points evaluated in bracketing the minimum. 
Number of cubic interpolations performed 
Number of inequality constraints 


Number of moves in search for solution of a 
subproblem 
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P f) 
Px 


x2 


RJ1 
SMAG 
TAL 


ENC 


ae 
X2 


X3 


Number of variables 

Number of consecutive step length reductions 
Indicates whether constraints are satisfied 

Number of the point on which the program is working 
Switch showing that a feasible point on the 
direction vector could not be found and the 
negative was tried. 

Penalty function value at current xvector P(X) 
Penalty function value at lower step length P(X3) 
Penalty function value at upper step length P(X2) 
Coefficient used in computing interpolated step length 
Vector of current values of the constraints 

Vector of previous values of the constraints 

Magnitude of the gradient of the penalty function 
Current step length 0 


Increment by which step's length increased or 
decreased 


Giternent )<- vector 

Initial starting point X vector 

X vector of upper step length X)+0,S 
X vector of lower step length X tO S 


Coefficient used in computing interpolated step 
length 
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GLOSSARY FOR QUADRATIC INTERPOLATION OPT SUBROUTINE 


DELX 


DELXO 


DOTT 


KTER 


KTR 


NFIRS 


NRED 


NSATIS 


NTCTR 


N405 


EO 


PX1L 


Interpolated step length 
Factor by which increment is multiplied 


Vector indicating the direction of move in one 
dimensional optimization S§S 


Gradient vector of the penalty function VP 


Directional derivative of initial starting point 
times search direction magnitude P'(X1) 


Index used in DO loops 
Index used in DO loops 
Index used in DO loops 


Number of points evaluated in bracketing the 
minimum 


Number of quadratic interpolations performed 
Number of inequality constraints 


Number of moves in search for solution of a 
subproblem 


Number of variables 


Indicates if more than two feasible step lengths 
found 


Number of consecutive step length reductions 
Indicates whether constraints are satisfied 
Number of the point on which the program is working 


Switch showing that a feasible point on the direction 
vector could not be found and the negative was tried 
Current penalty function value P(X) 


Penalty function value of lower step length P(X3) 
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PX2 
RJ 
TAL 
TALL 
TAL2 


TINC 


AX 
X1 
m2 


X3 


Penalty function value of upper step length 
Vector of previous values of the constraints 
Current step length 0 

Lower step length OF 

Upper step length oie 


Increment by which step length increased or 
decreased 


Cumreme Vector Xt Os 
Temporary storage used for switching values 
Initial starting point vector Xo 

X vector at upper step length X)+9,,S 

X vector of lower step length X 
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